Optimal reward harvesting in complex perceptual environments.
نویسندگان
چکیده
The ability to choose rapidly among multiple targets embedded in a complex perceptual environment is key to survival. Targets may differ in their reward value as well as in their low-level perceptual properties (e.g., visual saliency). Previous studies investigated separately the impact of either value or saliency on choice; thus, it is not known how the brain combines these two variables during decision making. We addressed this question with three experiments in which human subjects attempted to maximize their monetary earnings by rapidly choosing items from a brief display. Each display contained several worthless items (distractors) as well as two targets, whose value and saliency were varied systematically. We compared the behavioral data with the predictions of three computational models assuming that (i) subjects seek the most valuable item in the display, (ii) subjects seek the most easily detectable item, and (iii) subjects behave as an ideal Bayesian observer who combines both factors to maximize the expected reward within each trial. Regardless of the type of motor response used to express the choices, we find that decisions are influenced by both value and feature-contrast in a way that is consistent with the ideal Bayesian observer, even when the targets' feature-contrast is varied unpredictably between trials. This suggests that individuals are able to harvest rewards optimally and dynamically under time pressure while seeking multiple targets embedded in perceptual clutter.
منابع مشابه
A plastic corticostriatal circuit model of adaptation in perceptual decision making
The ability to optimize decisions and adapt them to changing environments is a crucial brain function that increase survivability. Although much has been learned about the neuronal activity in various brain regions that are associated with decision making, and about how the nervous systems may learn to achieve optimization, the underlying neuronal mechanisms of how the nervous systems optimize ...
متن کاملEfficient statistics, common currencies and the problem of reward-harvesting.
The mammalian brain is equipped with reward-harvesting mechanisms that efficiently categorize and value the behavioral choices that lead to rewards necessary for survival. In this context, 'efficiency' embodies the idea of achieving maximum returns for minimal energetic investments and places a premium on how an animal represents its available options. But the capacity to efficiently represent ...
متن کاملPolicy Adjustment in a Dynamic Economic Game
Making sequential decisions to harvest rewards is a notoriously difficult problem. One difficulty is that the real world is not stationary and the reward expected from a contemplated action may depend in complex ways on the history of an animal's choices. Previous functional neuroimaging work combined with principled models has detected brain responses that correlate with computations thought t...
متن کاملA Study of an Indirect Reward on Multi-agent Environments
In a multi-agent learning where multiple agents are learning, there is a problem about an indirect reward that is how to distribute a reward to an agent that does not obtain a reward directly.We have shown the theorem [3] about ”negative effect” of an indirect reward. This paper focuses on the ”positive effect” of an indirect reward such as an elimination of the perceptual aliasing problem [1]....
متن کاملMice infer probabilistic models for timing.
Animals learn both whether and when a reward will occur. Neural models of timing posit that animals learn the mean time until reward perturbed by a fixed relative uncertainty. Nonetheless, animals can learn to perform actions for reward even in highly variable natural environments. Optimal inference in the presence of variable information requires probabilistic models, yet it is unclear whether...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Proceedings of the National Academy of Sciences of the United States of America
دوره 107 11 شماره
صفحات -
تاریخ انتشار 2010